Recording apparatus and method, reproducing apparatus and  method, and program

ABSTRACT

The present invention relates to a recording apparatus and method, a reproducing apparatus and method, and a program that make it possible to photograph and record a still image and moving images before and after the still image as well. In step S 1 , when a still-image-with-moving-image photographing mode is set, moving image temporary storage is started. When a shutter is depressed in step S 2 , in step S 3 , a photographed still image is recorded and one moving image is generated from the moving image before the still image stored in step S 1 , a moving image obtained by converting the photographed still image, and a moving image photographed after the depression of the shutter and the one moving image generated is recorded. Therefore, the moving images before and after the still image are recorded together with a high-definition still image.

TECHNICAL FIELD

The present invention relates to a recording apparatus and method, areproducing apparatus and method, and a program, and, more particularlyto a recording apparatus and method, a reproducing apparatus and method,and a program suitable for photographing a still image, and movingimages before and after the still image as well, or reproducing an imageobtained as a result of the photographing.

BACKGROUND ART

Digital cameras are widespread as photographing apparatuses that canhold photographed images as digital data and can be easily used. Inrecent years, according to the advent of the high-performance CPU, it ispossible to photograph not only still images but also a moving imageusing the digital cameras.

A digital camera that can photograph a still image and moving imagesbefore and after the still image by using such a digital camera that canphotograph moving images as well has been devised (see Patent Document1).

[Patent Document 1] JP-A-2003-92724

DISCLOSURE OF THE INVENTION Problems to be solved by the Invention

However, in photographing a still image and moving images before andafter the still image, in the past, actually, only photographing of themoving images is performed. An image as a still image is generated fromone piece of image data photographed as a moving image. In other words,in the past, in photographing a still image and moving images before andafter the still image, a high-definition image peculiar to the stillimage cannot be reproduced.

The invention has been devised in view of such circumstances and makesit possible to photograph a still image and moving images before andafter the still image such that a high-definition still image can bereproduced.

Means for Solving the Problems

A first recording apparatus according to the invention is characterizedby including: setting means for performing setting of astill-image-with-moving-image photographing mode; still-imagephotographing means for performing photographing of a still image when astill-image photographing request is received while thestill-image-with-moving-image photographing mode is set; moving-imagephotographing means for performing photographing of a moving image whilethe still-image-with-moving-image photographing mode is set; generatingmeans for generating one incidental moving image on the basis of a stillimage obtained as a result of the photographing by the still-imagephotographing means and a moving image obtained as a result of thephotographing by the moving-image photographing means; and recordingmeans for recording the still image obtained as a result of thephotographing by the still-image photographing means and the incidentalmoving image generated by the generating means.

The generating means can generate the incidental moving image on thebasis of a first moving image obtained by converting the still imageobtained as a result of the photographing by the still-imagephotographing means into a moving image, a second moving imagephotographed by the moving-image photographing means before thephotographing of the still image by the still-image photographing means;and a third moving image photographed by the moving-image photographingmeans after the photographing of the still image by the still-imagephotographing means.

The generating means can generate the incidental moving image on thebasis of a first moving image obtained by converting the still imageobtained as a result of the photographing by the still-imagephotographing means into a moving image and a second moving imagephotographed by the moving-image photographing means before thephotographing of the still image by the still-image photographing means.

The generating means can generate the incidental moving image on thebasis of a first moving image obtained by converting the still imageobtained as a result of the photographing by the still-imagephotographing means into a moving image and a third moving imagephotographed by the moving-image photographing means after thephotographing of the still image by the still-image photographing means.

The moving-image photographing means can start photographing of a movingimage when the still-image-with-moving-image photographing mode is set.

The moving-image photographing means can start photographing of a movingimage when a power supply of the recording apparatus is turned on.

The moving-image photographing means can start photographing of a movingimage when a recording medium is inserted.

The generating means can add an effect to the first moving imageobtained by converting the still image obtained as a result of thephotographing by the still-image photographing means.

The generating means can provide a dummy frame before or after or beforeand after a frame of the first moving image obtained by converting thestill image obtained as a result of the photographing by the still-imagephotographing means.

The generating means can insert shutter sound, which is outputtedaccording to timing when the first moving image obtained by convertingthe still image obtained as a result of the photographing by thestill-image photographing means is reproduced, into the first movingimage.

It is possible to further provide first sound acquiring means foracquiring sound data of sound during the photographing of a moving imageby the moving image photographing means and second sound means foracquiring sound data of sound during the photographing of a still imageby the still-image photographing means. The generating means cangenerate the incidental moving image by multiplexing sound acquired bythe first sound acquiring means, which corresponds to the moving imageused for generating the incidental moving image, and all or a part ofthe sound data acquired by the second sound acquiring means, whichcorresponds to the still image used for generating the incidental movingimage.

The generating means can provide, when a frame rate of a moving image ona reproduction side is fixed, dummy frames in a number enough formaintaining the frame rate before or after or before and after a frameof the first moving image obtained by converting the still imageobtained as a result of the photographing by the still-imagephotographing means.

The generating means can provide, when a frame rate of a moving image ona reproduction side is variable, an arbitrary number of dummy framesbefore or after or before and after a frame of the first moving imageobtained by converting the still image obtained as a result of thephotographing by the still-image photographing means.

The generating means can extract a predetermined moving image out of amoving image photographed by the moving-image photographing means andgenerate the incidental moving image from the moving image extracted anda moving image obtained by converting the still image obtained as aresult of the photographing by the still-image photographing means.

The generating means can extract, when the moving image photographed bythe moving-image photographing means is formed by using inter-framecompression, a moving image headed by a frame for which only intra-framecompression is used or a frame forming a basis of the inter-framecompression.

The recording means can record the still image obtained as a result ofthe photographing by the still-image photographing means and theincidental moving image generated by the generating means under the samefile name.

It is possible to further provide display control means for displaying aUI image corresponding to a recorded image during the recording by therecording means

A first recording method according to the invention is characterized byincluding: a setting step of performing setting of astill-image-with-moving-image photographing mode; a still-imagephotographing step of performing photographing of a still image when astill-image photographing request is received while thestill-image-with-moving-image photographing mode is set; a moving-imagephotographing step of performing photographing of a moving image whilethe still-image-with-moving-image photographing mode is set; agenerating step of generating one incidental moving image on the basisof a still image obtained as a result of the photographing in processingin the still-image photographing step and a moving image obtained as aresult of the photographing in processing in the moving-imagephotographing step; and a recording step of recording the still imageobtained as a result of the photographing in the processing in thestill-image photographing step and the incidental moving image generatedin the processing in the generating step.

A first program according to the invention is characterized byincluding: a setting step of performing setting of astill-image-with-moving-image photographing mode; a still-imagephotographing step of performing photographing of a still image when astill-image photographing request is received while thestill-image-with-moving-image photographing mode is set; a moving-imagephotographing step of performing photographing of a moving image whilethe still-image-with-moving-image photographing mode is set; agenerating step of generating one incidental moving image on the basisof a still image obtained as a result of the photographing in processingin the still-image photographing step and a moving image obtained as aresult of the photographing in processing in the moving-imagephotographing step; and a recording step of recording the still imageobtained as a result of the photographing in the processing in thestill-image photographing step and the incidental moving image generatedin the processing in the generating step.

In the first recording apparatus, method, and program according to theinvention, the still-image-with-moving-image photographing mode is set,a still image is photographed when a still-image photographing requestis received while the still-image-with-moving-image photographing modeis set, a moving image is photographed while thestill-image-with-moving-image photographing mode is set, one incidentalmoving image is generated on the basis of the still image and the movingimage photographed, and the still image photographed and the incidentalmoving image generated are recorded.

A second recording apparatus according to the invention is characterizedby including: setting means for performing setting of astill-image-with-moving-image photographing mode; still-imagephotographing means for performing photographing of a still image when astill-image photographing request is received while thestill-image-with-moving-image photographing mode is set; moving-imagephotographing means for performing photographing of a moving image whilethe still-image-with-moving-image photographing mode is set; andrecording means for recording a still image obtained as a result of thephotographing by the still-image photographing means, a moving imagephotographed by the moving-image photographing means before thephotographing of the still image by the still-image photographing means,and a moving image photographed by the moving-image photographing meansafter the photographing of the still image by the still-imagephotographing means as different files.

A second recording method according to the invention is characterized byincluding: a setting step of performing setting of astill-image-with-moving-image photographing mode; a still-imagephotographing step of performing photographing of a still image when astill-image photographing request is received while thestill-image-with-moving-image photographing mode is set; a moving-imagephotographing step of performing photographing of a moving image whilethe still-image-with-moving-image photographing mode is set; and arecording step of recording a still image obtained as a result of thephotographing in processing in the still-image photographing step, amoving image photographed in the processing in the moving-imagephotographing step before the photographing of the still image in theprocessing in the still-image photographing step, and a moving imagephotographed in the processing in the moving-image photographing stepafter the photographing of the still image in the processing in thestill-image photographing step as different files.

A second recording program according to the invention is characterizedby including: a setting step of performing setting of astill-image-with-moving-image photographing mode; a still-imagephotographing step of performing photographing of a still image when astill-image photographing request is received while thestill-image-with-moving-image photographing mode is set; a moving-imagephotographing step of performing photographing of a moving image whilethe still-image-with-moving-image photographing mode is set; and arecording step of recording a still image obtained as a result of thephotographing in processing in the still-image photographing step, amoving image photographed in the processing in the moving-imagephotographing step before the photographing of the still image in theprocessing in the still-image photographing step, and a moving imagephotographed in the processing in the moving-image photographing stepafter the photographing of the still image in the processing in thestill-image photographing step as different files.

In the second recording apparatus, method, and program according to theinvention, the still-image-with-moving-image photographing mode is set,a still image is photographed when a still-image photographing requestis received while the still-image-with-moving-image photographing modeis set, a moving image is photographed while thestill-image-with-moving-image photographing mode is set, and the stillimage photographed, the moving image photographed before thephotographing of the still image, and the moving image photographedafter the photographing of the still image are recorded as differentfiles.

A first reproducing apparatus according to the invention that reproducesan image recorded by a recording apparatus characterized by includingsetting means for performing setting of a still-image-with-moving-imagephotographing mode, still-image photographing means for performingphotographing of a still image when a still-image photographing requestis received while the still-image-with-moving-image photographing modeis set, moving-image photographing means for performing photographing ofa moving image while the still-image-with-moving-image photographingmode is set, generating means for generating one incidental moving imageon the basis of a still image obtained as a result of the photographingby the still-image photographing means and a moving image obtained as aresult of the photographing by the moving-image photographing means, andrecording means for recording the still image obtained as a result ofthe photographing by the still-image photographing means and theincidental moving image generated by the generating means ischaracterized by including: first reproducing means for reproducing,when reproduction of a still image photographed in thestill-image-with-moving-image photographing mode is requested, the stillimage obtained as a result of the photographing by the still-imagephotographing means, which is recorded in the recording means of therecording apparatus; and second reproducing means for reproducing, whenreproduction of a moving image photographed in thestill-image-with-moving-image photographing mode is requested, theincidental moving image generated by the generating means, which isrecorded in the recording means of the recording apparatus.

The second reproducing means can reproduce, when the still imageobtained as a result of the photographing by the still-imagephotographing means and the incidental moving image generated by thegenerating means are recorded under the same file name by the recordingmeans of the recording apparatus, a moving image having a file name sameas that of a still image reproduced by the first reproducing means.

It is possible to further provide display control means for displaying athumbnail image of an image recorded in thestill-image-with-moving-image photographing setting mode and cause thedisplay control means to add an indication that the image isphotographed in the photographing-with-moving-image setting mode to thethumbnail image.

A first reproducing method according to the invention of reproducing animage recorded by a recording apparatus characterized by includingsetting means for performing setting of a still-image-with-moving-imagephotographing mode, still-image photographing means for performingphotographing of a still image when a still-image photographing requestis received while the still-image-with-moving-image photographing modeis set, moving-image photographing means for performing photographing ofa moving image while the still-image-with-moving-image photographingmode is set, generating means for generating one incidental moving imageon the basis of a still image obtained as a result of the photographingby the still-image photographing means and a moving image obtained as aresult of the photographing by the moving-image photographing means, andrecording means for recording the still image obtained as a result ofthe photographing by the still-image photographing means and theincidental moving image generated by the generating means ischaracterized by including: a first reproducing step of reproducing,when reproduction of a still image photographed in thestill-image-with-moving-image photographing mode is requested, the stillimage obtained as a result of the photographing by the still-imagephotographing means, which is recorded in the recording means of therecording apparatus; and a second reproducing step of reproducing, whenreproduction of a moving image photographed in thestill-image-with-moving-image photographing mode is requested, theincidental moving image generated by the generating means, which isrecorded in the recording means of the recording apparatus.

A first program according to the invention executed by a processor thatcontrols a reproducing apparatus that reproduces an image recorded by arecording apparatus characterized by including setting means forperforming setting of a still-image-with-moving-image photographingmode, still-image photographing means for performing photographing of astill image when a still-image photographing request is received whilethe still-image-with-moving-image photographing mode is set,moving-image photographing means for performing photographing of amoving image while the still-image-with-moving-image photographing modeis set, generating means for generating one incidental moving image onthe basis of a still image obtained as a result of the photographing bythe still-image photographing means and a moving image obtained as aresult of the photographing by the moving-image photographing means, andrecording means for recording the still image obtained as a result ofthe photographing by the still-image photographing means and theincidental moving image generated by the generating means ischaracterized by including: a first reproducing step of reproducing,when reproduction of a still image photographed in thestill-image-with-moving-image photographing mode is requested, the stillimage obtained as a result of the photographing by the still-imagephotographing means, which is recorded in the recording means of therecording apparatus; and a second reproducing step of reproducing, whenreproduction of a moving image photographed in thestill-image-with-moving-image photographing mode is requested, theincidental moving image generated by the generating means, which isrecorded in the recording means of the recording apparatus.

In the first reproducing apparatus, method, and program according to theinvention for reproducing an image recorded by a recording apparatuscharacterized by including setting means for performing setting of astill-image-with-moving-image photographing mode, still-imagephotographing means for performing photographing of a still image when astill-image photographing request is received while thestill-image-with-moving-image photographing mode is set, moving-imagephotographing means for performing photographing of a moving image whilethe still-image-with-moving-image photographing mode is set, generatingmeans for generating one incidental moving image on the basis of a stillimage obtained as a result of the photographing by the still-imagephotographing means and a moving image obtained as a result of thephotographing by the moving-image photographing means, and recordingmeans for recording the still image obtained as a result of thephotographing by the still-image photographing means and the incidentalmoving image generated by the generating means, when reproduction of astill image photographed in the still-image-with-moving-imagephotographing mode is requested, the still image obtained as a result ofthe photographing by the still-image photographing means, which isrecorded in the recording means of the recording apparatus, isreproduced and, when reproduction of a moving image photographed in thestill-image-with-moving image photographing mode is requested, theincidental moving image generated by the generating means, which isrecorded in the recording means of the recording apparatus, isreproduced.

A second reproducing apparatus according to the invention thatreproduces an image recorded by a recording apparatus characterized byincluding setting means for performing setting of astill-image-with-moving-image photographing mode, still-imagephotographing means for performing photographing of a still image when astill-image photographing request is received while thestill-image-with-moving-image photographing mode is set, moving-imagephotographing means for performing photographing of a moving image whilethe still-image-with-moving-image photographing mode is set, andrecording means for recording a still image obtained as a result of thephotographing by the still-image photographing means, a moving imagephotographed by the moving-image photographing means before thephotographing of the still image by the still-image photographing means,and a moving image photographed by the moving-image photographing meansafter the photographing of the still image by the still-imagephotographing means as different files is characterized by including:first reproducing means for reproducing, when reproduction of a stillimage photographed in the still-image-with-moving-image photographingmode is requested, the still image obtained as a result of thephotographing by the still-image photographing means, which is recordedin the recording means of the recording apparatus; and secondreproducing means for generating, when reproduction of a moving imagephotographed in the still-image-with-moving-image photographing mode isrequested, one incidental moving image on the basis of the still imageobtained as a result of the photographing by the still-imagephotographing means and the moving image obtained as a result of thephotographing by the moving-image photographing means and reproducingthe incidental moving image.

A second reproducing method according to the invention of reproducing animage recorded by a recording apparatus characterized by includingsetting means for performing setting of a still-image-with-moving-imagephotographing mode, still-image photographing means for performingphotographing of a still image when a still-image photographing requestis received while the still-image-with-moving-image photographing modeis set, moving-image photographing means for performing photographing ofa moving image while the still-image-with-moving-image photographingmode is set, and recording means for recording a still image obtained asa result of the photographing by the still-image photographing means, amoving image photographed by the moving-image photographing means beforethe photographing of the still image by the still-image photographingmeans, and a moving image photographed by the moving-image photographingmeans after the photographing of the still image by the still-imagephotographing means as different files is characterized by including: afirst reproducing step of reproducing, when reproduction of a stillimage photographed in the still-image-with-moving-image photographingmode is requested, the still image obtained as a result of thephotographing by the still-image photographing means, which is recordedin the recording means of the recording apparatus; and a secondreproducing step of generating, when reproduction of a moving imagephotographed in the still-image-with-moving-image photographing mode isrequested, one incidental moving image on the basis of the still imageobtained as a result of the photographing by the still-imagephotographing means and the moving image obtained as a result of thephotographing by the moving-image photographing means and reproducingthe incidental moving image.

A program according to the invention executed by a processor thatcontrols a reproducing apparatus that reproduces an image recorded by arecording apparatus characterized by including setting means forperforming setting of a still-image-with-moving-image photographingmode, still-image photographing means for performing photographing of astill image when a still-image photographing request is received whilethe still-image-with-moving-image photographing mode is set,moving-image photographing means for performing photographing of amoving image while the still-image-with-moving-image photographing modeis set, and recording means for recording a still image obtained as aresult of the photographing by the still-image photographing means, amoving image photographed by the moving-image photographing means beforethe photographing of the still image by the still-image photographingmeans, and a moving image photographed by the moving-image photographingmeans after the photographing of the still image by the still-imagephotographing means as different files is characterized by including: afirst reproducing step of reproducing, when reproduction of a stillimage photographed in the still-image-with-moving-image photographingmode is requested, the still image obtained as a result of thephotographing by the still-image photographing means, which is recordedin the recording means of the recording apparatus; and a secondreproducing step of generating, when reproduction of a moving imagephotographed in the still-image-with-moving-image photographing mode isrequested, one incidental moving image on the basis of the still imageobtained as a result of the photographing by the still-imagephotographing means and the moving image obtained as a result of thephotographing by the moving-image photographing means and reproducingthe incidental moving image.

In the second reproducing apparatus, method, and program according tothe invention for reproducing an image recorded by a recording apparatuscharacterized by including setting means for performing setting of astill-image-with-moving-image photographing mode, still-imagephotographing means for performing photographing of a still image when astill-image photographing request is received while thestill-image-with-moving-image photographing mode is set, moving-imagephotographing means for performing photographing of a moving image whilethe still-image-with-moving-image photographing mode is set, andrecording means for recording a still image obtained as a result of thephotographing by the still-image photographing means, a moving imagephotographed by the moving-image photographing means before thephotographing of the still image by the still-image photographing means,and a moving image photographed by the moving-image photographing meansafter the photographing of the still image by the still-imagephotographing means as different files, when reproduction of a stillimage photographed in the still-image-with-moving-image photographingmode is requested, the still image obtained as a result of thephotographing by the still-image photographing means, which is recordedin the recording means of the recording apparatus is reproduced and,when reproduction of a moving image photographed in thestill-image-with-moving-image photographing mode is requested, oneincidental moving image is generated on the basis of the still imageobtained as a result of the photographing by the still-imagephotographing means and the moving image obtained as a result of thephotographing by the moving-image photographing means and the incidentalmoving image is reproduced.

ADVANTAGES OF THE INVENTION

According to the first invention, it is possible to photograph andrecord a still image and a moving image at least before or after thestill image such that a high-definition still image can be reproduced.

According to the second invention, it is possible to reproduce a stillimage and moving images before and after the still image

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a block diagram showing an example of a structure of a digitalcamera for which the invention is provided.

FIG. 2 is a block diagram showing an example of a functional structureof the digital camera in FIG. 1.

FIG. 3 is a flowchart for explaining operations at the time of astill-image-with-moving-image photographing mode.

FIG. 4 is a flowchart for explaining details ofmoving-image-temporary-storage processing in step S1 in FIG. 3.

FIG. 5 is a flowchart for explaining details of recording processing instep S3 in FIG. 3.

FIG. 6 is a flowchart for explaining details of recording processing instep S81 in FIG. 5.

FIG. 7 is a diagram showing an example of a file list.

FIG. 8 is a diagram showing another example of the file list.

FIG. 9 is a diagram for explaining a still image and an incidentalmoving image recorded in the still-image-with-moving-image photographingmode.

FIG. 10 is another diagram for explaining a still image and anincidental moving image recorded in the still-image-with-moving-imagephotographing mode.

FIG. 11 is a flowchart for explaining display control processing at thetime of recording by the still-image-with-moving-image photographingmode.

FIG. 12 is a diagram showing an example of display during recording inthe still-image-with-moving-image photographing mode.

FIG. 13 is a diagram showing another example of display during recordingin the still-image-with-moving-image photographing mode.

FIG. 14 is a diagram showing still another example of display duringrecording in the still-image-with-moving-image photographing mode.

FIG. 15 is a diagram showing still another example of display duringrecording in the still-image-with-moving-image photographing mode.

FIG. 16 is a diagram showing still another example of display duringrecording in the still-image-with-moving-image photographing mode.

FIG. 17 is a flowchart for explaining file-list creation processing.

FIG. 18 is a diagram showing a file structure recorded in a recordingmedium 15 in FIG. 1.

FIG. 19 is a flowchart for explaining thumbnail display processing.

FIG. 20 is a diagram showing an example of display of thumbnails.

FIG. 21 is a flowchart for explaining processing for reproducing animage photographed in the still-image-with-moving-image photographingmode.

FIG. 22 is a diagram showing an example of an image displayed when animage photographed in the still-image-with-moving-image photographingmode is reproduced.

FIG. 23 is a diagram showing another example of an image displayed whenan image photographed in the still-image-with-moving-image photographingmode is reproduced.

FIG. 24 is a diagram showing an example of an image displayed when animage photographed in the still-image-with-moving-image photographingmode is reproduced.

FIG. 25 is a diagram showing another example of an image displayed whenan image photographed in the still-image-with-moving-image photographingmode is reproduced.

FIG. 26 is a diagram showing still another example of an image displayedwhen an image photographed in the still-image-with-moving-imagephotographing mode is reproduced.

FIG. 27 is another flowchart for explaining details of the recordingprocessing in step S3 in FIG. 3.

DESCRIPTION OF REFERENCE NUMERALS AND SIGNS

-   -   1 Digital Camera    -   11 CPU    -   12 ROM    -   13 RAM    -   14 Drive    -   15 Recording medium    -   21 Camera unit    -   22 Image processing unit    -   23 Still-image codec unit    -   24 Moving-image codec unit    -   25 Display control unit    -   26 Display unit    -   30 Microphone    -   31 Sound-signal processing unit    -   32 Sound codec unit    -   51 Image-data inputting unit    -   52 Camera control unit    -   53 Still-image processing unit    -   54 Still-image storing unit    -   55 Moving-image processing unit    -   56 Moving-image storing unit    -   57 File managing unit    -   71 Sound inputting unit

BEST MODE FOR CARRYING OUT THE INVENTION

Embodiments of the invention will be hereinafter explained. Acorrespondence relation between the invention described in thisspecification and the embodiments of the invention is illustrated asfollows. This description is to confirm that embodiments supporting theinvention described in this specification are described in thisspecification. Therefore, even if there is an embodiment described inthe embodiments of the invention but not described herein ascorresponding to the invention, this does not means that the embodimentdoes not correspond to the invention. Conversely, even if an embodimentis described herein as corresponding to the invention, this does notmean that the embodiment does not correspond to inventions other thanthe invention.

Moreover, this description does not mean all the inventions described inthis specification. In other words, this description does not denypresence of an invention described in this specification but not claimedin this application, that is, an invention that will be divisionallyapplied for patent or will appear or be added because of amendment infuture.

A first recording apparatus according to the invention is characterizedby including: setting means (e.g., a setting switch 28 in FIG. 1) forperforming setting of a still-image-with-moving-image photographingmode; still-image photographing means (e.g., a central control unit 62,a camera control unit 52, and a still-image processing unit 53 in FIG.2) for performing photographing of a still image when a still-imagephotographing request is received while thestill-image-with-moving-image photographing mode is set; moving-imagephotographing means (e.g., the central control unit 62, the cameracontrol unit 52, and the moving-image processing unit 55 in FIG. 2) forperforming photographing of a moving image while thestill-image-with-moving-image photographing mode is set; generatingmeans (e.g., the moving-image processing unit 55 in FIG. 2) forgenerating one incidental moving image on the basis of a still imageobtained as a result of the photographing by the still-imagephotographing means and a moving image obtained as a result of thephotographing by the moving-image photographing means; and recordingmeans (e.g., a file managing unit 57 and a recording medium 15 in FIG.2) for recording the still image obtained as a result of thephotographing by the still-image photographing means and the incidentalmoving image generated by the generating means.

The generating means can generate the incidental moving image on thebasis of a first moving image (e.g., a still-image corresponding movingimage Mc in FIG. 9) obtained by converting the still image obtained as aresult of the photographing by the still-image photographing means intoa moving image, a second moving image (e.g., a pre-moving image Maa inFIG. 9) photographed by the moving-image photographing means before thephotographing of the still image by the still-image photographing means;and a third moving image (e.g., a post-moving image Mbb in FIG. 9)photographed by the moving-image photographing means after thephotographing of the still image by the still-image photographing means.

The generating means can generate the incidental moving image on thebasis of a first moving image (e.g., the still-image correspondingmoving image Mc in FIG. 9) obtained by converting the still imageobtained as a result of the photographing by the still-imagephotographing means into a moving image and a second moving image (e.g.,the pre-moving image Maa in FIG. 9) photographed by the moving-imagephotographing means before the photographing of the still image by thestill-image photographing means.

The generating means can generate the incidental moving image on thebasis of a first moving image (e.g., the still-image correspondingmoving image Mc in FIG. 9) obtained by converting the still imageobtained as a result of the photographing by the still-imagephotographing means into a moving image and a third moving image (e.g.,the post-moving image Mbb in FIG. 9) photographed by the moving-imagephotographing means after the photographing of the still image by thestill-image photographing means.

The generating means can add an effect (e.g., a frame Ea in FIG. 9) tothe first moving image obtained by converting the still image obtainedas a result of the photographing by the still-image photographing means.

The generating means can provide a dummy frame (e.g., dummy frames in Din FIG. 9) before or after or before and after a frame of the firstmoving image obtained by converting the still image obtained as a resultof the photographing by the still-image photographing means.

The generating means can insert shutter sound (e.g., shutter sound shownin FIG. 25), which is outputted according to timing when the firstmoving image obtained by converting the still image obtained as a resultof the photographing by the still-image photographing means isreproduced, into the first moving image.

It is possible to further provide first sound acquiring means (e.g., asound inputting unit 71 and a moving-image processing unit 55 in FIG. 2)for acquiring sound data of sound during the photographing of a movingimage by the moving image photographing means and second sound means(e.g., the sound inputting unit 71 and the moving-image processing unit55 in FIG. 2) for acquiring sound data of sound during the photographingof a still image by the still-image photographing means. The generatingmeans can generate the incidental moving image by multiplexing soundacquired by the first sound acquiring means, which corresponds to themoving image used for generating the incidental moving image, and all ora part of the sound data acquired by the second sound acquiring means,which corresponds to the still image used for generating the incidentalmoving image (e.g., FIG. 26).

The generating means can provide, when a frame rate of a moving image ona reproduction side is fixed, dummy frames (e.g., dummy frames in D inFIG. 10) in a number enough for maintaining the frame rate before orafter or before and after a frame of the first moving image obtained byconverting the still image obtained as a result of the photographing bythe still-image photographing means.

The generating means can provide, when a frame rate of a moving image ona reproduction side is variable, an arbitrary number of dummy frames(e.g., the dummy frames in D in FIG. 9) before or after or before andafter a frame of the first moving image obtained by converting the stillimage obtained as a result of the photographing by the still-imagephotographing means.

The generating means can extract a predetermined moving image (e.g.,frames Ma4 to Ma17 in E in FIG. 9) out of moving images (e.g., framesMa1 to Ma17 in FIG. 9) photographed by the moving-image photographingmeans and generate the incidental moving image from the moving imageextracted and a moving image obtained by converting the still imageobtained as a result of the photographing by the still-imagephotographing means.

The generating means can extract, when the moving image photographed bythe moving-image photographing means is formed by using inter-framecompression, a moving image headed by a frame for which only intra-framecompression is used or a frame (e.g., an i picture) forming a basis ofthe inter-frame compression.

The recording means can record the still image obtained as a result ofthe photographing by the still-image photographing means and theincidental moving image generated by the generating means under the samefile name (e.g., DSC0002 shown in FIG. 18).

It is possible to further provide display control means for displaying aUI image (e.g., an image shown in FIGS. 12 to 16) corresponding to arecorded image during the recording by the recording means

A first recording method according to the invention is characterized byincluding: a setting step (e.g., processing by a control-signalinputting unit 61 and the central control unit 62 in FIG. 2) ofperforming setting of a still-image-with-moving-image photographingmode; a still-image photographing step (e.g., steps S43, S52, S61, andS81 in FIG. 5) of performing photographing of a still image when astill-image photographing request is received while thestill-image-with-moving-image photographing mode is set; a moving-imagephotographing step (e.g., step S1 in FIG. 3 and steps S44, S53, S54, andS74 in FIG. 5) of performing photographing of a moving image while thestill-image-with-moving-image photographing mode is set; a generatingstep (e.g., steps S72 to S75 in FIG. 5) of generating one incidentalmoving image on the basis of a still image obtained as a result of thephotographing in processing in the still-image photographing step and amoving image obtained as a result of the photographing in processing inthe moving-image photographing step; and a recording step (e.g., stepS83 in FIG. 5) of recording the still image obtained as a result of thephotographing in the processing in the still-image photographing stepand the incidental moving image generated in the processing in thegenerating step.

A second recording apparatus according to the invention is characterizedby including: setting means (e.g., the setting switch 28 in FIG. 1) forperforming setting of a still-image-with-moving-image photographingmode; still-image photographing means (e.g., the central control unit62, the camera control unit 52, and the still-image processing unit 53in FIG. 2) for performing photographing of a still image when astill-image photographing request is received while thestill-image-with-moving-image photographing mode is set; moving-imagephotographing means (e.g., the central control unit 62, the cameracontrol unit 52, and the moving-image processing unit 55 in FIG. 2) forperforming photographing of a moving image while thestill-image-with-moving-image photographing mode is set; and recordingmeans (e.g., the file managing unit 57 and the recording medium 15 inFIG. 2) for recording a still image obtained as a result of thephotographing by the still-image photographing means, a moving imagephotographed by the moving-image photographing means before thephotographing of the still image by the still-image photographing means,and a moving image photographed by the moving-image photographing meansafter the photographing of the still image by the still-imagephotographing means as different files.

A first reproducing apparatus according to the invention that reproducesan image recorded by a recording apparatus characterized by includingsetting means for performing setting of a still-image-with-moving-imagephotographing mode, still-image photographing means for performingphotographing of a still image when a still-image photographing requestis received while the still-image-with-moving-image photographing modeis set, moving-image photographing means for performing photographing ofa moving image while the still-image-with-moving-image photographingmode is set, generating means for generating one incidental moving imageon the basis of a still image obtained as a result of the photographingby the still-image photographing means and a moving image obtained as aresult of the photographing by the moving-image photographing means, andrecording means for recording the still image obtained as a result ofthe photographing by the still-image photographing means and theincidental moving image generated by the generating means ischaracterized by including: first reproducing means (e.g., the centralcontrol unit 62 and the still-image processing unit 53 in FIG. 2) forreproducing, when reproduction of a still image photographed in thestill-image-with-moving-image photographing mode is requested, the stillimage obtained as a result of the photographing by the still-imagephotographing means, which is recorded in the recording means of therecording apparatus; and second reproducing means (e.g., the centralcontrol unit 62 and the moving-image processing unit 55 in FIG. 2) forreproducing, when reproduction of a moving image photographed in thestill-image-with-moving-image photographing mode is requested, theincidental moving image generated by the generating means, which isrecorded in the recording means of the recording apparatus.

It is possible to further provide display control means for displaying athumbnail image of an image recorded in thestill-image-with-moving-image photographing setting mode and cause thedisplay control means to add an indication that the image isphotographed in the photographing-with-moving-image setting mode to thethumbnail image (e.g., an icon QHR shown in FIG. 20).

A first reproducing method according to the invention of reproducing animage recorded by a recording apparatus characterized by includingsetting means for performing setting of a still-image-with-moving-imagephotographing mode, still-image photographing means for performingphotographing of a still image when a still-image photographing requestis received while the still-image-with-moving-image photographing modeis set, moving-image photographing means for performing photographing ofa moving image while the still-image-with-moving-image photographingmode is set, generating means for generating one incidental moving imageon the basis of a still image obtained as a result of the photographingby the still-image photographing means and a moving image obtained as aresult of the photographing by the moving-image photographing means, andrecording means for recording the still image obtained as a result ofthe photographing by the still-image photographing means and theincidental moving image generated by the generating means ischaracterized by including: a first reproducing step (e.g., steps S142,S151, S172, S152, S143, and S131 in FIG. 21) of reproducing, whenreproduction of a still image photographed in thestill-image-with-moving-image photographing mode is requested, the stillimage obtained as a result of the photographing by the still-imagephotographing means, which is recorded in the recording means of therecording apparatus; and a second reproducing step (steps S145, S161,S173, S174, S162, S146, and S132 in FIG. 21) of reproducing, whenreproduction of a moving image photographed in thestill-image-with-moving-image photographing mode is requested, theincidental moving image generated by the generating means, which isrecorded in the recording means of the recording apparatus.

A second reproducing apparatus according to the invention thatreproduces an image recorded by a recording apparatus characterized byincluding setting means for performing setting of astill-image-with-moving-image photographing mode, still-imagephotographing means for performing photographing of a still image when astill-image photographing request is received while thestill-image-with-moving-image photographing mode is set, moving-imagephotographing means for performing photographing of a moving image whilethe still-image-with-moving-image photographing mode is set, andrecording means for recording a still image obtained as a result of thephotographing by the still-image photographing means, a moving imagephotographed by the moving-image photographing means before thephotographing of the still image by the still-image photographing means,and a moving image photographed by the moving-image photographing meansafter the photographing of the still image by the still-imagephotographing means as different files is characterized by including:first reproducing means (e.g., the central control unit 62 and thestill-image processing unit 53 in FIG. 2) for reproducing, whenreproduction of a still image photographed in thestill-image-with-moving-image photographing mode is requested, the stillimage obtained as a result of the photographing by the still-imagephotographing means, which is recorded in the recording means of therecording apparatus; and second reproducing means (e.g., the centralcontrol unit 62 and the moving-image processing unit 55 in FIG. 2) forgenerating, when reproduction of a moving image photographed in thestill-image-with-moving-image photographing mode is requested, oneincidental moving image on the basis of the still image obtained as aresult of the photographing by the still-image photographing means andthe moving image obtained as a result of the photographing by themoving-image photographing means and reproduces the incidental movingimage.

FIG. 1 shows an example of a structure of a digital camera 1 to whichthe invention is applied. This digital camera 1 can normally photographa still image and a moving image (has a still-image photographing modeand a moving-image photographing mode) and can automatically photographa still image and moving images for a predetermined time before andafter the still image (has a still-image-with-moving-image photographingmode). The digital camera 1 can reproduce images photographed in therespective modes.

A CPU (Central Processing Unit) 11 executes various kinds of processingin accordance with a program recorded in a ROM (Read Only Memory) 12.Data and the like necessary when the CPU 11 executes the various kindsof processing are also stored in the RAM 13 as appropriate.

A drive 14 records image data and the like supplied from the CPU 11 in arecording medium 15 formed by a magnetic disk, an optical disk, amagneto-optical disk, a hard disk, a semiconductor memory, or the likeand reads out the image data recorded in the recording medium 15 andsupplies the image data to the CPU 11.

It is also possible that, when the recording medium 15 is removable anda program running on the digital camera 1 is stored in the recordingmedium 15, the drive 14 reads out the program from the recording medium15 and the CPU 11 executes the program.

A camera unit 21 includes a lens and a CCD (Charged Coupled Device) andsupplies image data (a 10-bit digital signal) obtained as a result ofimaging to an image processing unit 22.

The image processing unit 22 applies image processing such as gammaconversion, color space conversion, and white balance to the image datasupplied from the camera unit 21 and supplies image data (a digitalsignal of a YUV (4:2:2) or YUV (4:2:0) format) obtained as a result ofthe image processing to the CPU 11.

A still-image codec unit 23 applies JPEG (Joint Photographic ExpertsGroup) compression processing to the image data (digital image data ofthe YUV format) processed by the image processing unit 22, which issupplied from the CPU 11, and returns image data (image data of a stillimage) obtained as a result of the JPEG compression processing to theCPU 11. The still-image codec unit 23 applies JPEG expansion processingto JPEG-compressed image data stored in, for example, the recordingmedium 15, which is supplied from the CPU 11, and returns image data(digital image data of the YUV format) of the still image obtained as aresult of the JPEG expansion processing to the CPU 11.

A moving-image codec unit 24 applies MPEG (Moving Picture Experts Group)compression processing to moving image data (YUV digital image data)processed by the image processing unit 22, which is supplied from theCPU 11, and returns image data of a moving image obtained as a result ofthe MPEG compression processing to the CPU 11. The moving-image codecunit 24 applies MPEG expansion processing to MPEG-compressed image datastored in, for example, the recording medium 15, which is supplied fromthe CPU 11, and returns image data (digital image data of the YUVformat) of a moving image obtained as a result of the MPEG expansionprocessing to the CPU 11.

A display control unit 25 converts the image data (YUV digital imagedata) supplied from the CPU 11 into an RGB signal and supplies the RGBsignal to a display unit 26 formed by an LCD (Liquid Crystal Display) orthe like and causes the display unit 26 to display the image data.

A shutter switch 27 is a switch operated by a user in photographing astill image.

A still-image-with-moving-image photographing-mode setting switch 28 isa switch operated by the user in setting a still-image-with-moving-imagephotographing mode. Although the still-image-with-moving-imagephotographing mode is set using the still-image-with-moving-imagephotographing-mode setting switch 28 in this example, setting of thestill-image-with-moving-image photographing mode may be performed usinga GUI (Graphical User Interface) such as a menu screen.

An operation button group 29 is a button group necessary when the useroperates the digital camera 1 such as a cross key and a determinationbutton. The still-image photographing mode for photographing a normalstill image and the moving-image photographing mode for photographing anormal moving image are set by operating predetermined buttons of thisoperation button group 29.

A microphone 30 supplies a sound signal obtained as a result of soundcollection to a sound-signal processing unit 31.

The sound processing unit 31 applies predetermined sound processing tothe sound signal inputted from the microphone 30 and supplies sound dataobtained as a result of the sound processing to the CPU 11.

A sound codec unit 32 applies MPEG audio compression processing to thesound data processed by the sound-signal processing unit 31 and returnssound data obtained as a result of the MPEG audio compression processingto the CPU 11. The sound codec unit 32 applies MPEG expansion processingto MPEG-compressed sound data recorded in, for example, the recordingmedium, which is supplied from the CPU 11, and returns sound dataobtained as a result of the MPEG expansion processing to the CPU 11.

An output control unit 33 outputs the sound data supplied from the CPU11 via a speaker 34.

FIG. 2 shows an example of a functional structure of the digital camera1.

An image-data inputting unit 51 inputs image data captured by the cameraunit 21 (FIG. 1) and supplies the inputted image data to a cameracontrol unit 52.

The camera control unit 52 generates image data (e.g., 2592×1944 dots)for a still image from the image data supplied from the image-datainputting unit 51 and supplies the image data to a still-imageprocessing unit 53 or generates image data (320×240 dots) for a movingimage from the image data supplied from the image-data inputting unit 51and supplies the image data to a moving-image processing unit 55 inaccordance with the control by the central control unit 62.

The still-image processing unit 53 requests the still-image codec unit23 to apply the JPEG compression processing to the image data of thestill image supplied from the camera control unit 52 and supplies imagedata of a still image obtained as a result of the JPEG compressionprocessing, which is supplied from the still-image codec unit 23, to afile managing unit 57 in accordance with the control by the centralcontrol unit 62.

When the still-image processing unit 53 records a still imagephotographed in the still-image-with-moving-image photographing mode,the still-image processing unit 53 temporarily stores image datacompressed by the JPEG compression processing in a still-image storingunit 54 formed by a RAM 13 (FIG. 1).

The still-image processing unit 53 requests the still-image codec unit23 to apply the JPEG expansion processing to the JPEG-compressed imagedata recorded in the recording medium 15 and supplies image dataobtained as a result of the JPEG expansion processing, which is suppliedfrom the still-image coded unit 23, to the central control unit 62 inaccordance with the control by the central control unit 62.

The moving-image processing unit 55 requests the moving-image codec unit24 to apply the MPEG compression processing to the image data of themoving image supplied from the camera control unit 52 and supplies imagedata obtained as a result of the MPEG compression processing, which issupplied from the moving-image codec unit 24, to the file managing unit57 in accordance with the control by the central control unit 62. Inthat case, the moving-image processing unit 55 requests the sound codecunit 32 to apply the MPEG compression processing to sound datacorresponding to a moving image supplied from a sound inputting unit 71and supplies sound data obtained as a result of the MPEG compressionprocessing, which is supplied from the sound codec unit 32, to the filemanaging unit 57.

When the moving-image processing unit 55 records a moving imagephotographed in the still-image-with-moving-image photographing mode,the moving-image processing unit 55 stores the image data supplied fromthe camera control unit 52 and the sound data supplied from the soundinputting unit 71 in a moving-image storing unit 56 formed by the RAM 13and generates a moving image described later using the image data andthe like stored therein.

The moving-image processing unit 55 requests the moving-image codec unit24 to apply the MPEG expansion processing to the MPEG-compressed imagedata stored in the recording medium 15, which is supplied from the filemanaging unit 57, and supplies image data of a moving image obtained asa result of the MPEG expansion processing, which is supplied from themoving-image codec unit 24, to the central control unit 62 in accordancewith the control by the central control unit 62. In that case, themoving-image processing unit 55 requests the sound codec unit 32 toapply the MPEG expansion processing to the MPEG-compressed sound datarecorded in the recording medium 15, which is supplied from the filemanaging unit 57, and supplies sound data obtained as a result of theMPEG expansion processing, which is supplied from the sound codec unit32, to the central control unit 62.

The file-managing unit 57 records the image data and the like suppliedfrom the still-image processing unit 53 and the moving-image processingunit 55 in the recording medium 15. The file managing unit 57 suppliesthe image data and the like stored in the recording medium 15 to thestill-image processing unit 53 or the moving-image processing unit 55according to requests from the still-image processing unit 53 and themoving-image processing unit 55.

A control-signal inputting unit 61 inputs a signal corresponding tooperation of the shutter switch 27 or the operation button group 29 bythe user and supplies the signal to the central control unit 62.

The central control unit 62 controls the camera control unit 52, thestill-image processing unit 53, and the moving-image processing unit 55according to the signal inputted from the control-signal inputting unit61 to cause the units to perform photographing of a still image or amoving image in the normal still-image photographing mode ormoving-image photographing mode and reproduction of the image,photographing of an image in the still-image-with-moving-imagephotographing mode and reproduction of the image, and the like.

Now, operations of the digital camera 1 at the time when thestill-image-with-moving-image photographing-mode setting switch 28 isoperated and the still-image-with-moving-image photographing mode is setwill be explained with reference to a flowchart in FIG. 3.

In step S1, moving-image temporary storage processing is started.Details of the processing are shown in FIG. 4.

In step S11, the central control unit 62 of the digital camera 1receives a signal indicating that the still-image-with-moving-imagephotographing-mode setting switch 28 is operated and thestill-image-with-moving-image photographing mode is set from thecontrol-signal inputting unit 61. In step S12, the central control unit62 notifies the camera control unit 52 of a command for setting anoperation mode of the camera control unit 52 in the moving-imagerecording mode.

In step S21, the camera control unit 52 sets the operation mode of thecamera control unit 52 in the moving-image recording mode and, when thesetting is completed, notifies the central control unit 62 to thateffect. When the operation mode is set in the moving-image recordingmode, the camera control unit 52 generates image data (320×240 dots) ofa moving image from the image data supplied from the image-datainputting unit 51 and performs processing for supplying the image datato the moving-image processing unit 55 in response to a request.

When the central control unit 62 receives the notification of thecompletion of the moving-image recording mode setting from the cameracontrol unit 52, in step S13, the central control unit 62 outputs amoving-image temporary storage command to the moving-image processingunit 55.

In step S31, the moving-image processing unit 55 starts the moving-imagetemporary storage processing.

Specifically, the moving-image processing unit 55 requests the cameracontrol unit 52 (the camera control unit 52 in the moving-imagerecording mode) to supply image data of a moving image. The moving-imageprocessing unit 55 starts the MPEG compression processing for the imagedata supplied from the camera control unit 52 in response to the request(step S22) and starts storage of image data obtained as a result of theMPEG compression processing in the moving-image storing unit 56. Themoving-image storing unit 56 is, for example, a line buffer. When thebuffer is filled, image data of an old frame is deleted and image dataof a new frame is stored.

In that case, the moving-image processing unit 55 starts the MPEGcompression processing for a sound signal (a sound signal of soundcorresponding to the moving image stored) supplied from the soundinputting unit 71 and starts storage of sound data obtained as a resultof the MPEG compression processing in the moving-image storing unit 56.

When the moving-image temporary storage is started in this way, theprocessing proceeds to step S2 in FIG. 3. In the case of this example,when the still-image-with-moving-image photographing mode is set, themoving-image temporary storage is started. However, it is also possibleto start the moving-image temporary storage when the power supply of thedigital camera 1 is turned on or when the recording medium 15 isinserted.

In step S2, it is judged whether the shutter switch 27 is operated. Whenit is judged that the shutter switch 27 is operated (the user pressesthe shutter switch 27), the processing proceeds to step S3.

In step S3, recording processing is performed. Details of the processingare shown in a flowchart in FIG. 5.

When the shutter switch 27 is operated during the moving-image temporarystorage (during the moving-image temporary storage started in step S1 inFIG. 3 or step S74 described later), in step S41, the central controlunit 62 outputs a command for stopping the moving-image temporarystorage to the moving-image processing unit 55. In step S71, themoving-image processing unit 55 stops the moving-image temporary storage(stops the storage of the moving image and the sound) and notifies thecentral control unit 62 that the moving-image temporary storage isstopped.

When the moving-image temporary storage is stopped, in step S42, thecentral control unit 62 outputs a command for setting the operation modeof the camera control unit 52 in the still-image recording mode to thecamera control unit 52.

In step S51, when the operation mode is set in the still-image recordingmode and the setting is completed, the camera control unit 52 notifiesthe central control unit 62 to that effect. When the operation mode isset in the still-image recording mode, the camera control unit 52performs processing for generating image data (2592×1944 dots) of astill image data from the image data supplied from the image-datainputting unit 51 and supplying the image data to the still-imageprocessing unit 53 in response to a request.

When the completion of the still-image record mode setting is notifiedfrom the camera control unit 52, in step S43, the central control unit62 outputs a still-image recording command to the still-image processingunit 53.

In step S61, the still-image processing unit 53 performs still-imagerecording processing. Specifically, the still-image processing unit 53requests the camera control unit 52 (the camera control unit 52 in thestill-image recording mode) to supply image data of a still image,applies the JPEG compression processing to image data of a still imagesupplied from the camera control unit 52 in response to the request(step S52) (image data of one frame imaged at the point when the shutterswitch 27 is depressed), and stores image data obtained as a result ofthe JPEG compression processing in the still-image storing unit 54.

The still-image processing unit 53 applies reduction processing to theimage data of the still image supplied from the camera control unit 52and also applies the JPEG compression processing to the image data togenerate a thumbnail image.

The still-image processing unit 53 includes the thumbnail image in theimage data stored in the still-image storing unit 54 and supplies theimage data to the file managing unit 57.

When the image data is supplied from the still-image processing unit 53,in step S81, the file managing unit 57 records the image data in therecording medium 15. Detailed processing of the recording is shown in aflowchart in FIG. 6.

In step S91, with reference to, for example, a file list shown in FIG. 7managed by the file managing unit 57, the file managing unit 57 adds 1to a largest number among file numbers set in the file list and sets avalue obtained as a result of the addition as a file number of the imagedata (sets a number not used in the file list as a file number of theimage data to be recorded).

In the example in FIG. 7, since a number 2 is the largest number, anumber 3 obtained by adding 1 to the number 2 is a file number of theimage data to be recorded.

Details of the file list will be described later.

In step S92, the file managing unit 57 attaches an extension for a stillimage to a file name including the file number determined in step S91and stores the image data supplied from the still-image processing unit53 in a predetermined folder and records the image data in the recordingmedium 15.

For example, the file name has a form of DSCXXXXX. The file number isincorporated in the part “XXXXX” in the file name. In the example inFIG. 7, since the file number is 3 (00003), the file name is DSC00003and the image data is recorded with JPG as an extension for a stillimage attached to the file name (DSC0003.JPG).

In step S93, the file managing unit 57 adds the file number used in thefile name and information (Hybrid REC) indicating that the still imageis photographed in the still-image-with-moving-image photographing modeto spaces of “file number” and “file type” of the file list,respectively. In other words, the file list in FIG. 7 is updated withthe file number 3 and the information (Hybrid REC) added thereto asshown in FIG. 8.

When the image data of the still image is recorded in this way, theprocessing proceeds to step S82 in FIG. 5. The file managing unit 57notifies the central control unit 62, via the still-image processingunit 53 and the camera control unit 52, that the recording of the imagedata of the still image is completed.

When the recording of the image data of the still image is completed, instep S44, the central control unit 62 outputs amoving-image-recording-mode setting command to the camera control unit52.

In step S53, as in the case in step S21 in FIG. 4, the camera controlunit 52 sets the operation mode in the moving-image recording mode and,when the setting is completed, notifies the central control unit 62 tothat effect.

When the operation mode of the camera control unit 52 is set in themoving-image recording mode, in step S45, the central control unit 62outputs a command for recording a moving image photographed in thestill-image-with-moving-image photographing mode (hereinafter referredto as incidental moving image) to the moving-image processing unit 55.

When the moving-image processing unit 55 receives this command, in stepS72, the moving-image processing unit 55 creates a pre-moving image Maa.

Specifically, the moving-image processing unit 55 extracts predeterminedimage data as image data of the pre-moving image Maa from the image dataof the moving image stored in the moving-image storing unit 56 accordingto the moving-image temporary storage performed until being stopped instep S71.

For example, as shown in A in FIG. 9, frames Ma1 to Ma17 of a movingimage (frames of a moving image photographed immediately before theshutter switch 27 is operated) are stored in the moving-image storingunit 56. Then, a frame Ma4, which is a frame a predetermined time backfrom the frame Ma17, to the frame Ma17 are extracted as image data ofthe pre-moving image Maa. A frame S represents the still imagephotographed in the still-image-with-moving-image photographing mode(the still image compressed in step S61).

The moving-image processing unit 55 also extracts sound datacorresponding to the moving image, which is extracted as the pre-movingimage Maa, from the sound data stored in the moving-image storing unit56 according to the moving-image temporary storage performed until beingstopped in step S71.

Referring back to FIG. 5, in step S73, the moving-image processing unit55 generates a moving image corresponding to the still imagephotographed (hereinafter referred to as still-image correspondingmoving image) Mc.

Specifically, the moving-image processing unit 55 requests, via thecentral control unit 62, the still-image processing unit 53 to supplythe image data of the still image stored in step S61 (in the case of theexample in A in FIG. 9, the image data of the frame S). The moving-imageprocessing unit 55 converts the image data of the still image from thestill-image processing unit 53, which is supplied via the centralcontrol unit 62, into image data of a moving image and generates imagedata of the still-image corresponding moving image Mc shown in B in FIG.9. In other words, the image data of the still image of 2592×1944 dotsis converted into image data of 320×240 dots.

At this point, as shown in C in FIG. 9, it is possible to generate thestill-image corresponding moving image Mc by adding an effect such as aframe Ea thereto (such that the still image is displayed while beingsurrounded by the frame Ea).

Further, as shown in D in FIG. 9, it is also possible to generate thestill-image corresponding moving image Mc by providing dummy framesformed by image data of a black color before and after a frame of themoving image obtained from the still image (such that screens having ablack background are displayed before and after the still image). In theexample in D in FIG. 9, the dummy frames are provided before and afterthe frame of the moving image obtained from the still image. However, itis also possible to provide a dummy frame only before or only after theframe.

Besides, it is also possible to add effects described below.

Fade-in or fade-out from a moving image to a still image or from a stillimage to a moving image

Wipe processing from a moving image to a still image or from a stillimage to a moving image

Mix processing from a moving image to a still image or from a stillimage to a moving image

Display of a still image in sepia, negative/positive, or monotone

Animation-in from the upper right or animation-out to the upper right ofa still image

Animation for enlarging a still image from a small state to a fullscreen

Referring back to FIG. 5, in step S74, the moving-image processing unit55 creates a post-moving image Mbb.

Specifically, the moving-image processing unit 55 requests the cameracontrol unit 52 (the camera control unit 52 in the moving-imagerecording mode) to supply image data of a moving image. The moving-imageprocessing unit 55 applies the MPEG compression processing to image dataof a moving image supplied from the camera control unit 52 (step S54) tocompress the image data and starts temporary storage of the image datain the moving-image storing unit 56. A scene after the shutter switch 27is pressed is stored as a moving image. In starting the storage,contents stored in the moving-image storing unit 56 are initialized(image data stored is deleted).

The moving-image processing unit 55 also starts storage of a soundsignal (sound data corresponding to the moving image to be recorded)supplied from the sound inputting unit 71 in the moving-image storingunit 56.

After a certain time has elapsed, the moving-image processing unit 55generates a post-moving image Mbb from the moving image stored in themoving-image storing unit 56 at that point.

Specifically, predetermined moving-image data is extracted as image dataof the post-moving image Mbb from the image data of the moving imagestored in the moving-image storing unit 56.

For example, when image data of a frame Mb1 and the subsequent framesshown in A in FIG. 9 is stored in the moving-image storing unit 56,frames Mb1 to Mb8 are extracted as the image data of the post-movingimage Mbb.

The moving-image processing unit 55 also extracts sound datacorresponding to the moving image, which is extracted as the post-movingimage, from the sound data stored in the moving-image storing unit 56.

In steps S72 and S74, the predetermined image data is extracted from theimage data of the moving image recorded in the moving-image storing unit56 to generate the pre-moving image Maa and the post-moving image Mbb.In that case, when frames of the moving image form I, B, and P pictures,it is also possible to extract image data headed by the I picture thatis reproducible independently.

In step S75, the moving-image processing unit 55 generates a movingimage of a still image with moving image (an incidental moving image).

Specifically, as shown in E in FIG. 9, the pre-moving image Maagenerated in step S72, the still-image corresponding moving image Mcgenerated in step S73, and the post-moving image Mbb generated in stepS74 are arranged in a time series order to generate one moving image.

The one moving image generated and sound data corresponding to thepre-moving image Maa and the post-moving image Mbb extracted (steps S72and S74) are multiplexed to generate an incidental moving image.

In the examples in D and E in FIG. 9, a frame rate on a reproductionside is a variable frame rate. However, when the frame rate is a fixedframe rate, as shown in D in FIG. 10 and E in FIG. 10, it is possible togenerate an incidental moving image by providing dummy frames enough forfixing the frame rate. A in FIG. 10 to C in FIG. 10 show a frame arraysame as that in A in FIG. 9 to C in FIG. 9.

The moving-image processing unit 55 supplies the incidental moving imagegenerated to the file-managing unit 57.

When the incidental moving image is supplied from the moving-imageprocessing unit 55, in step S83, the file managing unit 57 records theincidental moving image in the recording medium 15.

Specifically, the file managing unit 57 records, with an extension (MP4)for a moving image attached to a name same as the file name of the stillimage given in step S92 in FIG. 6, the incidental moving image in thesame file in which the image data of the still image is recorded.

When the recording of the incidental moving image is completed, the filemanaging unit 57 notifies the central control unit 62 to that effect viathe moving-image processing unit 55 and the camera control unit 52.

When the recording processing is performed in this way, the processingreturns to step S2 in FIG. 3 and the processing in step S2 and thesubsequent steps is performed. When the shutter switch 27 is operatedagain, photographing in the still-image-with-moving-image photographingmode is performed and a still image and an incidental moving image arerecorded.

When it is judged in step S2 that the shutter switch 27 is not operated,the processing proceeds to step S4. It is judged whether the setting ofthe still-image-with-moving-image photographing mode is released. Whenit is judged that the setting is not released, the processing returns tostep S2 and the processing in step S2 and the subsequent steps isperformed. On the other hand, when it is judged that the setting isreleased (e.g., when the still-image-with-moving-imagephotographing-mode setting switch 28 is operated to release thesetting), the processing proceeds to step S5 and an operationcorresponding to the setting of the user is performed. For example,thereafter, when the photographing mode is switched to the still-imagephotographing mode, normal still-image photographing is performed. Whenthe photographing mode is switched to the moving-image photographingmode, normal moving-image photographing is performed.

As described above, photographing in the still-image-with-moving-imagephotographing mode is performed.

The recording processing is mainly explained above concerning thestill-image-with-moving-image photographing mode. At the time of therecording, display control processing for a UI (user interface) imageconforming to processing shown in a flowchart in FIG. 11 explained belowis performed.

In step S101, the central control unit 62 of the digital camera 1receives, from the control-signal inputting unit 61, a signal indicatingthat the still-image-with-moving-image photographing-mode setting switch28 is operated and the still-image-with-moving-image photographing modeis set (step S1 in FIG. 3 and step S11 in FIG. 4). In step S102, asshown in FIG. 12, the central control unit 62 continuously displays animage currently photographed, which is supplied from the camera controlunit 52, (performs monitor processing using an electronic view finder)and displays, on the image, an icon QHR indicating that thestill-image-with-moving-image photographing mode is set.

The shutter switch 27 is operated in step S103 (step S2 in FIG. 3 andstep S41 in FIG. 5). Then, in step S104, when the shutter switch 27 iscompletely pressed, the central control unit 62 switches a display imageon the display unit 26 to a screen with characters “recording” attachedto a black background as shown in FIG. 13 in order to indicate that thescreen is being captured.

When recording of the still image is started in step S105 (step S43 inFIG. 5), in step S106, as shown in FIG. 14, the central control unit 62displays the still image and displays the characters “recording” inorder to indicate that the still image is being recorded.

When generation and recording of an incidental moving image is startedin step S107 (step S45 in FIG. 5), in step S108, as shown in FIG. 15,the central control unit 62 erases the display of “recording” from thescreen in FIG. 14 and displays a mark P2 indicating that the incidentalmoving image is being generated and recorded.

When the generation and recording of the incidental moving image iscompleted in step S109 (a notification to that effect (step S84 in FIG.5) is received from the file managing unit 57), in step S110, as shownin FIG. 16, the central control unit 62 erases the mark P2 from thescreen in FIG. 15.

As described above, the predetermined UI image is displayed during thephotographing in the still-image-with-moving-image photographing mode.Thus, the user can easily grasp what kind of processing is beingcurrently performed.

Operations of the file managing unit 57 in generating the file list(FIG. 7) will be explained with reference to a flowchart in FIG. 17.

For example, when the recording medium 15 is inserted in the digitalcamera 1 at the time of power-on, in step S121, the file managing unit57 reads out all file names present in the recording medium 15 insertedand extracts file numbers forming the file names. When there are plural(two) files having the same file name, one file number is extracted.

For example, as shown in FIG. 18, when files of DSC0001.JPG,DSC00002.JPG, and DSC00002.MP4 are recorded in the recording medium 15,a file number 1 and a file number 2 (since DSC00002.JPG and DSC00002.MP4has the same file name DSC00002, one file number 2) are extracted fromthe file name of DSC0001 and the file name DSC00002, respectively.

Referring back to FIG. 17, in step S122, the file managing unit 57determines a file type for each of the file numbers.

When there is only one same file name, a file type is determined inaccordance with an extension attached to the file. For example, in theexample in FIG. 18, since there is one file having the file name ofDSC00001, in accordance with the extension (JPG) attached to the file,the file is considered to be a file of a still image photographed in thenormal still-image photographing mode.

On the other hand, when there are two same file names, in the case ofthis example, since the files are files with extensions JPG and MP4attached to the same name and are photographed in thestill-image-with-moving-image photographing mode, the files areconsidered to be files of an image photographed in thestill-image-with-moving-image photographing mode.

Next, in step S123, the file managing unit 57 sets the file numbers(step S121) and the file types (step S122) in the file list.

As a result, in the example in FIG. 18, as shown in FIG. 7, a file listin which the file number 1 and information indicating that the file is afile of a still image photographed in the still-image photographing mode(JPEG) and the file number 2 and information indicating that the file isa file of an image photographed in the still-image-with-moving-imagephotographing mode (Hybrid REC) are set, respectively, is generated.

The file list is generated as described above.

Now, processing for reproducing an image photographed in thestill-image-with-moving-image photographing mode will be explained.First, processing for displaying thumbnails used in selecting an imageto be reproduced will be explained with reference to a flowchart in FIG.19.

When the operation group button 29 is operated to request display ofthumbnails and an indication to that effect is inputted via thecontrol-signal inputting unit 61, in step S131, the central control unit62 acquires a file list from the file managing unit 57. In step S132,the central control unit 62 reads out a pair of a file number and a filetype set in the file list.

In step S133, the central control unit 62 determines an iconcorresponding to the file list read out.

In step S134, the central control unit 62 acquires a thumbnail image ofa file name including the file number from the file managing unit 57,attaches the icon determined in step S133 to the thumbnail image, andcauses the display unit 26 to display the thumbnail image.

In step S135, the central control unit 62 judges whether all filenumbers have been read out from the file list. When it is judged thatthere are file numbers not read out yet, the processing returns to stepS132. The central control unit 62 performs the processing in step S132and the subsequent steps. On the other hand, when it is judged that allthe file numbers have been read out, the central control unit 62 endsthe processing.

FIG. 20 shows an example of thumbnail images displayed in this way. Anicon QHR is attached to thumbnail images of an image photographed in thestill-image-with-moving-image photographing mode and an icon Qs isattached to a thumbnail image of an image photographed in the normalstill-image photographing mode.

Operations of the digital camera 1 in reproducing an image photographedin the still-image-with-moving-image photographing mode will beexplained with reference to a flowchart in FIG. 21.

For example, when the thumbnail image attached with the icon QHRdisplayed as described above is selected and reproduction of thethumbnail image is requested, in step S141, the central control unit 62receives a signal indicating to that effect supplied from thecontrol-signal inputting unit 61. In step S142, the central control unit62 outputs a still-image reproduction command for a still imagephotographed in the still-image-with-moving-image photographing mode tothe still-image processing unit 53.

In step S151, the still-image processing unit 53 requests the filemanaging unit 57 to read out a file of the still image photographed inthe still-image-with-moving-image photographing mode.

In step S171, the file managing unit 57 retrieves the file of the stillimage photographed in the still-image-with-moving-image photographingmode (the image data of the still image recorded in step S81 in FIG. 5)from the recording medium 15. In step S172, the file managing unit 57supplies the file (the image data of the still image) to the still-imageprocessing unit 53.

In step S152, the still-image processing unit 53 applies the JPEGexpansion processing to the image data of the still image supplied fromthe file managing unit 57 and supplies image data obtained as a resultof the JPEG expansion processing to the central control unit 62.

In step S143, the central control unit 62 supplies the expanded imagedata of the still image, which is supplied from the still-imageprocessing unit 53, to the display unit 26 and instructs the displayunit 26 to display the still image. As a result, in step S131, theselected still image photographed in the still-image-with-moving-imagephotographing mode is displayed on the display unit 26.

In FIG. 22, an example of display of the still image photographed in thestill-image-with-moving-image photographing mode displayed on thedisplay unit 26 at this point is shown. This still image is ahigh-definition image having the number of pixels same as that of thestill image photographed in the normal still-image photographing mode.

In the case of this example, a button B1 operated in reproducing anincidental moving image is displayed during the display of this stillimage.

After the still image photographed in the still-image-with-moving-imagephotographing mode is displayed on the display unit 26 as shown in FIG.22, reproduction of a moving image (an incidental moving image)photographed in the still-image-with-moving-image photographing mode isrequested (e.g., the button B1 in FIG. 22 is operated). In step S144,the central control unit 62 receives, from the control-signal inputtingunit 61, a signal indicating that the request is received. In step S145,the central control unit 62 outputs an incidental-moving-imagereproduction command to the moving-image processing unit 55.

In step S161, the moving-image processing unit 55 requests the filemanaging unit 57 to read out a file of the incidental moving image.

In step S173, the file managing unit 57 retrieves a file having a filename same as that of the file of the still image retrieved in step S171and attached with an extension of a moving image (the incidental movingimage recorded in step S83 in FIG. 5) from the recording medium 15. Instep S174, the file managing unit 57 supplies the file to themoving-image processing unit 55.

In step S162, the moving-image processing unit 55 applies the MPEGexpansion processing to image data and sound data of the file suppliedfrom the file managing unit 57 and supplies image data and sound dataobtained as a result of the MPEG expansion processing to the centralcontrol unit 62.

In step S146, the central control unit 62 supplies the image data of themoving image expanded, which is supplied from the moving-imageprocessing unit 55, to the display unit 26 and causes the display unit26 to display the moving image. The central control unit 62 outputssound data via the speaker 34. As a result, in step S132, the incidentalmoving image of the still image with moving image is reproduced anddisplayed on the display unit 26.

For example, when an incidental moving image is generated as shown in Ein FIG. 9, as shown in FIG. 23, the pre-moving image Maa (a scene beforethe shutter switch 27 is operated), the still-image corresponding movingimage Mc (a dummy frame, a moving image generated from a still imagephotographed when the shutter switch 27 is operated, and a dummy frame),and the post-moving image Mbb (a scene after the shutter switch 27 isoperated) are displayed in order.

As sound, during the display of the pre-moving image Maa and thepost-moving image Mbb, sound corresponding to the recorded moving imagethereof (steps S72 and S74 in FIG. 5) is outputted and, during thedisplay of the still-image corresponding moving image Mc, no sound isoutputted.

In the case of this example, while an incidental moving image of a stillimage with moving image is displayed, as shown in FIG. 24, it is alsopossible to display a button B2 operated in stopping reproduction of themoving image. When the reproduction of the incidental moving image ends,the processing returns to the still image display.

The image photographed in the still-image-with-moving-imagephotographing mode is reproduced as described above.

In the above description, at the time of recording, an incidental movingimage is generated from the pre-moving image Maa, the still-imagecorresponding moving image Mc, and the post-moving image Mbb andrecorded. At the time of reproduction, the incidental moving image isreproduced according to the normal moving image processing.

However, depending on performance of the reproduction processing, it ispossible to, without generating the still-image corresponding movingimage Mc and the incidental moving image at the time of recording,record the pre-moving image Maa and the post-moving image Mbb and thestill image S separately and, at the time of reproduction, generate thestill-image corresponding moving image Mc and reproduce the pre-movingimage Maa, the still-image corresponding moving image Mc, and thepost-moving image Mbb in this order.

In this case, it is possible to record the pre-moving image Maa and thepost-moving image Mbb and the still image S in an identical directoryunder file names with first four characters different for each of theimages as described below. A reproduction side identifies, from thefirst four characters, the pre-moving image Maa, the post-moving imageMbb, and the still image S and, from a character string (a numbersequence) (00001) after that, grasps that these images are relatedimages.

File name of the pre-moving image Maa: PRE00001.MP4

File name of the post-moving image Mbb: PST00001.MP4

File name of the still image S: DSC00001.JPG

It is also possible to record the images in an identical directory withthe same file name and different extensions as described below. In thiscase, the reproduction side grasps a relation according to a file nameand identifies a type of an image according to an extension.

File name of the pre-moving image Maa: DSC00001.PRE

File name of the post-moving image Mbb: DSC00001.PST

File name of the still image S: DSC00001.JPG

It is also possible to further record the still-image correspondingmoving image Mc and, at the time of reproduction, directly reproduce thestill-image corresponding moving image Mc or generate the still-imagecorresponding moving image Mc and then reproduce the still-imagecorresponding moving image Mc. In this case, when the first fourcharacters of the file names are changed, the still-image correspondingmoving image Mc is recorded as, for example, a file of DSC00001.MP4(although the file name is the same as the file name DSC00001.JPG of thestill image S, it is possible to identify the file name becauseidentifiers are different). When the extension is changed, thestill-image corresponding moving image Mc is recorded as a file ofDSC00001.PIC.

When the pre-moving image Maa, the still image S, and the post-movingimage Mbb are recorded in different files in this way, it is possible toeasily delete, for example, only the pre-moving image Maa or only thepost-moving image Mbb. When there is no still-image corresponding movingimage Mc, it is possible to reduce an overall file size and, moreover,reproduce a still image having a high image quality.

When an incidental moving image is generated and stored, it is possibleto perform reproduction of the incidental moving image according to thegeneral reproduction processing. Thus, it is possible to execute thereproduction using a general-purpose application. In other words, it isunnecessary to prepare a special application for reproduction on thereproduction side.

The invention and a moving image treated are not limited to apredetermined format. It is possible to use MPEG2 and MPEG4-AVC otherthan MPEG4.

In the above description, it is possible to set any one of “only beforephotographing of a still image”, “only after photographing of a stillimage”, and “before and after photographing of a still image” on a menuscreen or the like.

In the above description, the digital camera is explained as an example.However, the invention is not limited to the digital camera. It ispossible to apply the invention to apparatuses having a recordingfunction and a reproduction function including a cellular phone and aPDA (Personal Digital Assistant).

In the example in FIG. 23, during the display of the pre-moving imageMaa and the post-moving image Mbb, sound corresponding to the recordedmoving image thereof is outputted and, during the display of thestill-image corresponding moving image Mc, no sound is outputted.However, as shown in FIG. 25, it is also possible to output shuttersound at predetermined timing when the still-image corresponding movingimage Mc is displayed in order to indicate that a still image displayedis a still image imaged when the shutter switch 27 is operated. Theshutter sound may be inserted into the still-image corresponding movingimage Mc at the time of recording in the same manner as the dummyframes.

As shown in FIG. 26, it is also possible to record sound as well at thetime of photographing of a still image and output the recorded sound(extracted sound) from predetermined timing during the display of thestill-image corresponding moving image Mc (in the example in FIG. 26,from one second before reproduction of the post-moving image Mbb).

By outputting the sound in this way, it is possible to improvecontinuity of the change from the still-image corresponding moving imageMc to the post-moving image Mbb.

Recording processing (step S3 in FIG. 3) in outputting sound as shown inFIG. 26 will be explained with reference to a flowchart in FIG. 27.

When the shutter switch 27 is operated during moving-image temporarystorage, in step S201, the central control unit 62 outputs a command forstopping the moving-image temporary storage to the moving-imageprocessing unit 55 (processing same as step S41 in FIG. 5). In stepS231, the moving-image processing unit 55 stops the moving-imagetemporary storage (stops storage of a moving image and sound) andnotifies the central control unit 62 that the moving-image temporarystorage is stopped (processing same as step S71 in FIG. 5).

When the moving-image temporary storage is stopped, in step S202, thecentral control unit 62 outputs a command for setting an operation modeof the camera control unit 52 in the still-image recording mode to thecamera control unit 52 (processing same as step S42 in FIG. 5).

In step S211, the camera control unit 52 sets the operation mode in thestill-image recording mode and, when the setting is completed, notifiesthe central control unit 62 to that effect (processing same as step S51in FIG. 5). When the operation mode is set in the still-image recordingmode, the camera control unit 52 performs processing for generatingimage data (2592×1944 dots) of a still image from image data suppliedfrom the image-data inputting unit 51 and supplies the image data to thestill-image processing unit 53 in response to a request.

When completion of the setting of the still-image recording mode isnotified from the camera control unit 52, in step S203, the centralcontrol unit 62 outputs a moving-image temporary storage command to themoving-image processing unit 55.

In step S232, the moving-image processing unit 55 starts sound storageprocessing and notifies the central control unit 62 to that effect.

In this case, the operation mode of the camera control unit 52 is set inthe still-image recording mode according to the processing in step S211and the moving-image processing unit 55 cannot acquire image data fromthe camera control unit 52. Thus, the moving-image processing unit 55stores only sound data supplied from the sound inputting unit 71. Inother words, sound recording during the still image photographing isstarted.

In step S204, the central control unit 62 outputs a still-imagerecording command to the still-image processing unit 53 (processing sameas step S43 in FIG. 5).

In step S221, the still-image processing unit 53 performs still-imagerecording processing and supplies image data obtained as a result of thestill-image recording processing to the file managing unit 57(processing same as step S61 in FIG. 5).

When image data is supplied from the still-image processing unit 53, instep S241, the file managing unit 57 records the image data in therecording medium 15 (processing same as step S81 in FIG. 5).

When the image data of the still image is recorded, the processingproceeds to step S242. The file managing unit 57 notifies, via thestill-image processing unit 53 and the camera control unit 52, thecentral control unit 62 that the recording of the image data of thestill image is completed (processing same as step S82 in FIG. 5).

When the recording of the image data of the still image is completed, instep S205, the central control unit 62 outputs a command for stoppingthe moving-image temporary storage started according to the command instep S203 to the moving-image processing unit 55.

In step S233, the moving-image processing unit 55 stops the soundstorage started in step S232 and notifies the central control unit 62that the sound storage is stopped.

When the operation mode of the camera control unit 52 is the still-imagerecording mode as described above, the moving-image processing unit 55does not store the moving image and stores only sound even if themoving-image temporary storage command is received. Thus, the soundstorage is stopped.

In step S206, the central control unit 62 outputs amoving-image-recording-mode setting command to the camera control unit52 (processing same as step s44 in FIG. 5).

In step S213, the camera control unit 52 sets the operation mode in themoving-image recording mode and, when the setting is completed, notifiesthe central control unit to that effect (processing same as step S53 inFIG. 5).

When the operation mode of the camera control unit 52 is set in themoving-image recording mode, in step S207, the central control unit 62outputs a command for recording a moving image photographed in thestill-image-with-moving-image photographing mode to the moving-imageprocessing unit 55 (processing same as step S45 in FIG. 5).

When the moving-image processing unit 55 receives this command, in stepS234, the moving-image processing unit 55 extracts a moving imageserving as the pre-moving image Maa and sound corresponding thereto(processing same as step S72 in FIG. 5).

In step S235, the moving-image processing unit 55 generates thestill-image corresponding moving image Mc. At this point, themoving-image processing unit 55 extracts predetermined sound data (inthe case of the example in FIG. 26, sound data from one second beforereproduction of the post-moving image Mbb) from the sound data storedduring the still image recording (the sound data stored from the startof the processing in step S232 until the stop of the processing in stepS233).

In step S236, the moving-image processing unit 55 extracts a movingimage serving as the post-moving image Mbb and sound correspondingthereto (processing same as step S74 in FIG. 5).

In step S237, the moving-image processing unit 55 generates one movingimage in which the pre-moving image Maa, the still-image correspondingmoving image Mc generated in step S73, and the post-moving image Mbbgenerated in step S74 are arranged in a time series order, multiplexessound data corresponding to the pre-moving image Maa and the post-movingimage Mbb and the sound data extracted in step S235 to generate anincidental moving image, and supplies the incidental moving image to thefile managing unit 57.

When the incidental moving image is supplied from the moving-imageprocessing unit 55, in step S243, the file managing unit 57 records theincidental moving image in the recording medium 15 (processing same asstep S83 in FIG. 5).

When the recording of the incidental moving image is completed, the filemanaging unit 57 notifies the central control unit 62 to that effect viathe moving-image processing unit 55 and the camera control unit 52(processing same as step S84 in FIG. 5).

When the series of processing is executed by software, a program formingthe software is installed, from a network or a recording medium, in acomputer built in dedicated hardware or, for example, a general-purposepersonal computer capable of executing various functions by installingvarious program therein.

The recording medium 15 is not only formed by a package medium such as amagnetic disk (including a floppy disk), an optical disk (including aCD-ROM (Compact Disk-Read Only Memory) and a DVD (Digital VersatileDisk)), and a magneto-optical disk (including an MD (Mini-Disk)(trademark)), or a semiconductor memory having the program storedtherein, which is distributed separately from the apparatus body inorder to supply the program to the user, but also formed by the ROM 12,a hard disk, or the like having the program stored therein, which issupplied to the user while being built in the apparatus body in advance.

In this specification, steps describing a program recorded in arecording medium include not only processing performed in time seriesaccording to the order described but also processing not alwaysperformed in time series but executed in parallel or individually.

Embodiments of the invention are not limited to the embodimentsdescribed above. Various modifications of the embodiments are possiblewithout departing from the spirit of the invention.

1. A recording apparatus characterized by comprising: setting means forperforming setting of a still-image-with-moving-image photographingmode; still-image photographing means for performing photographing of astill image when a still-image photographing request is received whilethe still-image-with-moving-image photographing mode is set;moving-image photographing means for performing photographing of amoving image while the still-image-with-moving-image photographing modeis set; generating means for generating one incidental moving image onthe basis of a still image obtained as a result of the photographing bythe still-image photographing means and a moving image obtained as aresult of the photographing by the moving-image photographing means; andrecording means for recording the still image obtained as a result ofthe photographing by the still-image photographing means and theincidental moving image generated by the generating means.
 2. Arecording apparatus according to claim 1, characterized in that thegenerating means generates the incidental moving image on the basis of afirst moving image obtained by converting the still image obtained as aresult of the photographing by the still-image photographing means intoa moving image, a second moving image photographed by the moving-imagephotographing means before the photographing of the still image by thestill-image photographing means; and a third moving image photographedby the moving-image photographing means after the photographing of thestill image by the still-image photographing means.
 3. A recordingapparatus according to claim 1, characterized in that the generatingmeans generates the incidental moving image on the basis of a firstmoving image obtained by converting the still image obtained as a resultof the photographing by the still-image photographing means into amoving image and a second moving image photographed by the moving-imagephotographing means before the photographing of the still image by thestill-image photographing means.
 4. A recording apparatus according toclaim 1, characterized in that the generating means generates theincidental moving image on the basis of a first moving image obtained byconverting the still image obtained as a result of the photographing bythe still-image photographing means into a moving image and a thirdmoving image photographed by the moving-image photographing means afterthe photographing of the still image by the still-image photographingmeans.
 5. A recording apparatus according to claim 1, characterized inthat the moving-image photographing means starts photographing of amoving image when the still-image-with-moving-image photographing modeis set.
 6. A recording apparatus according to claim 1, characterized inthat the moving-image photographing means starts photographing of amoving image when a power supply of the recording apparatus is turnedon.
 7. A recording apparatus according to claim 1, characterized in thatthe moving-image photographing means starts photographing of a movingimage when a recording medium is inserted.
 8. A recording apparatusaccording to claim 2, characterized in that the generating means adds aneffect to the first moving image obtained by converting the still imageobtained as a result of the photographing by the still-imagephotographing means.
 9. A recording apparatus according to claim 8,characterized in that the generating means provides a dummy frame beforeor after or before and after a frame of the first moving image obtainedby converting the still image obtained as a result of the photographingby the still-image photographing means.
 10. A recording apparatusaccording to claim 8, characterized in that the generating means insertsshutter sound, which is outputted according to timing when the firstmoving image obtained by converting the still image obtained as a resultof the photographing by the still-image photographing means isreproduced, into the first moving image.
 11. A recording apparatusaccording to claim 1, characterized by further comprising: first soundacquiring means for acquiring sound data of sound during thephotographing of a moving image by the moving image photographing means;and second sound means for acquiring sound data of sound during thephotographing of a still image by the still-image photographing means,and in that the generating means generates the incidental moving imageby multiplexing sound acquired by the first sound acquiring means, whichcorresponds to the moving image used for generating the incidentalmoving image, and all or a part of the sound data acquired by the secondsound acquiring means, which corresponds to the still image used forgenerating the incidental moving image.
 12. A recording apparatusaccording to claim 9, characterized in that the generating meansprovides, when a frame rate of a moving image on a reproduction side isfixed, dummy frames in a number enough for maintaining the frame ratebefore or after or before and after a frame of the first moving imageobtained by converting the still image obtained as a result of thephotographing by the still-image photographing means.
 13. A recordingapparatus according to claim 9, characterized in that the generatingmeans provides, when a frame rate of a moving image on a reproductionside is variable, an arbitrary number of dummy frames before or after orbefore and after a frame of the first moving image obtained byconverting the still image obtained as a result of the photographing bythe still-image photographing means.
 14. A recording apparatus accordingto claim 1, characterized in that the generating means extracts apredetermined moving image out of a moving image photographed by themoving-image photographing means and generates the incidental movingimage from the moving image extracted and a moving image obtained byconverting the still image obtained as a result of the photographing bythe still-image photographing means.
 15. A recording apparatus accordingto claim 14, characterized in that the generating means extracts, whenthe moving image photographed by the moving-image photographing means isformed by using inter-frame compression, a moving image headed by aframe for which only intra-frame compression is used or a frame forminga basis of the inter-frame compression.
 16. A recording apparatusaccording to claim 1, characterized in that the recording means recordsthe still image obtained as a result of the photographing by thestill-image photographing means and the incidental moving imagegenerated by the generating means under the same file name.
 17. Arecording apparatus according to claim 1, characterized by furthercomprising display control means for displaying a UI image correspondingto a recorded image during the recording by the recording means.
 18. Arecording method characterized by comprising: a setting step ofperforming setting of a still-image-with-moving-image photographingmode; a still-image photographing step of performing photographing of astill image when a still-image photographing request is received whilethe still-image-with-moving-image photographing mode is set; amoving-image photographing step of performing photographing of a movingimage while the still-image-with-moving-image photographing mode is set;a generating step of generating one incidental moving image on the basisof a still image obtained as a result of the photographing in processingin the still-image photographing step and a moving image obtained as aresult of the photographing in processing in the moving-imagephotographing step; and a recording step of recording the still imageobtained as a result of the photographing in the processing in thestill-image photographing step and the incidental moving image generatedin the processing in the generating step.
 19. A program executed by aprocessor that controls a recording apparatus that records an image,characterized by comprising: a setting step of performing setting of astill-image-with-moving-image photographing mode; a still-imagephotographing step of performing photographing of a still image when astill-image photographing request is received while thestill-image-with-moving-image photographing mode is set; a moving-imagephotographing step of performing photographing of a moving image whilethe still-image-with-moving-image photographing mode is set; agenerating step of generating one incidental moving image on the basisof a still image obtained as a result of the photographing in processingin the still-image photographing step and a moving image obtained as aresult of the photographing in processing in the moving-imagephotographing step; and a recording step of recording the still imageobtained as a result of the photographing in the processing in thestill-image photographing step and the incidental moving image generatedin the processing in the generating step.
 20. A recording apparatuscharacterized by comprising: setting means for performing setting of astill-image-with-moving-image photographing mode; still-imagephotographing means for performing photographing of a still image when astill-image photographing request is received while thestill-image-with-moving-image photographing mode is set; moving-imagephotographing means for performing photographing of a moving image whilethe still-image-with-moving-image photographing mode is set; andrecording means for recording a still image obtained as a result of thephotographing by the still-image photographing means, a moving imagephotographed by the moving-image photographing means before thephotographing of the still image by the still-image photographing means,and a moving image photographed by the moving-image photographing meansafter the photographing of the still image by the still-imagephotographing means as different files.
 21. A recording methodcharacterized by comprising: a setting step of performing setting of astill-image-with-moving-image photographing mode; a still-imagephotographing step of performing photographing of a still image when astill-image photographing request is received while thestill-image-with-moving-image photographing mode is set; a moving-imagephotographing step of performing photographing of a moving image whilethe still-image-with-moving-image photographing mode is set; and arecording step of recording a still image obtained as a result of thephotographing in processing in the still-image photographing step, amoving image photographed in the processing in the moving-imagephotographing step before the photographing of the still image in theprocessing in the still-image photographing step, and a moving imagephotographed in the processing in the moving-image photographing stepafter the photographing of the still image in the processing in thestill-image photographing step as different files.
 22. A programexecuted by a processor that controls a recording apparatus that recordsan image, characterized by comprising: a setting step of performingsetting of a still-image-with-moving-image photographing mode; astill-image photographing step of performing photographing of a stillimage when a still-image photographing request is received while thestill-image-with-moving-image photographing mode is set; a moving-imagephotographing step of performing photographing of a moving image whilethe still-image-with-moving-image photographing mode is set; and arecording step of recording a still image obtained as a result of thephotographing in processing in the still-image photographing step, amoving image photographed in the processing in the moving-imagephotographing step before the photographing of the still image in theprocessing in the still-image photographing step, and a moving imagephotographed in the processing in the moving-image photographing stepafter the photographing of the still image in the processing in thestill-image photographing step as different files.
 23. A reproducingapparatus that reproduces an image recorded by a recording apparatuscharacterized by including: setting means for performing setting of astill-image-with-moving-image photographing mode; still-imagephotographing means for performing photographing of a still image when astill-image photographing request is received while thestill-image-with-moving-image photographing mode is set; moving-imagephotographing means for performing photographing of a moving image whilethe still-image-with-moving-image photographing mode is set; generatingmeans for generating one incidental moving image on the basis of a stillimage obtained as a result of the photographing by the still-imagephotographing means and a moving image obtained as a result of thephotographing by the moving-image photographing means; and recordingmeans for recording the still image obtained as a result of thephotographing by the still-image photographing means and the incidentalmoving image generated by the generating means, the reproducingapparatus characterized by comprising: first reproducing means forreproducing, when reproduction of a still image photographed in thestill-image-with-moving-image photographing mode is requested, the stillimage obtained as a result of the photographing by the still-imagephotographing means, which is recorded in the recording means of therecording apparatus; and second reproducing means for reproducing, whenreproduction of a moving image photographed in thestill-image-with-moving-image photographing mode is requested, theincidental moving image generated by the generating means, which isrecorded in the recording means of the recording apparatus.
 24. Areproducing apparatus according to claim 23, characterized in that thesecond reproducing means reproduces, when the still image obtained as aresult of the photographing by the still-image photographing means andthe incidental moving image generated by the generating means arerecorded under the same file name by the recording means of therecording apparatus, a moving image having a file name same as that of astill image reproduced by the first reproducing means.
 25. A reproducingapparatus according to claim 24, characterized by further comprisingdisplay control means for displaying a thumbnail image of an imagerecorded in the still-image-with-moving-image photographing settingmode, and in that the display control means adds an indication that theimage is photographed in the photographing-with-moving-image settingmode to the thumbnail image.
 26. A reproducing method of reproducing animage recorded by a recording apparatus characterized by including:setting means for performing setting of a still-image-with-moving-imagephotographing mode; still-image photographing means for performingphotographing of a still image when a still-image photographing requestis received while the still-image-with-moving-image photographing modeis set; moving-image photographing means for performing photographing ofa moving image while the still-image-with-moving-image photographingmode is set; generating means for generating one incidental moving imageon the basis of a still image obtained as a result of the photographingby the still-image photographing means and a moving image obtained as aresult of the photographing by the moving-image photographing means; andrecording means for recording the still image obtained as a result ofthe photographing by the still-image photographing means and theincidental moving image generated by the generating means, thereproducing method characterized by comprising: a first reproducing stepof reproducing, when reproduction of a still image photographed in thestill-image-with-moving-image photographing mode is requested, the stillimage obtained as a result of the photographing by the still-imagephotographing means, which is recorded in the recording means of therecording apparatus; and a second reproducing step of reproducing, whenreproduction of a moving image photographed in thestill-image-with-moving-image photographing mode is requested, theincidental moving image generated by the generating means, which isrecorded in the recording means of the recording apparatus.
 27. Aprogram executed by a processor that controls a reproducing apparatusthat reproduces an image recorded by a recording apparatus characterizedby including: setting means for performing setting of astill-image-with-moving-image photographing mode; still-imagephotographing means for performing photographing of a still image when astill-image photographing request is received while thestill-image-with-moving-image photographing mode is set; moving-imagephotographing means for performing photographing of a moving image whilethe still-image-with-moving-image photographing mode is set; generatingmeans for generating one incidental moving image on the basis of a stillimage obtained as a result of the photographing by the still-imagephotographing means and a moving image obtained as a result of thephotographing by the moving-image photographing means; and recordingmeans for recording the still image obtained as a result of thephotographing by the still-image photographing means and the incidentalmoving image generated by the generating means, the programcharacterized by comprising: a first reproducing step of reproducing,when reproduction of a still image photographed in thestill-image-with-moving-image photographing mode is requested, the stillimage obtained as a result of the photographing by the still-imagephotographing means, which is recorded in the recording means of therecording apparatus; and a second reproducing step of reproducing, whenreproduction of a moving image photographed in thestill-image-with-moving-image photographing mode is requested, theincidental moving image generated by the generating means, which isrecorded in the recording means of the recording apparatus.
 28. Areproducing apparatus that reproduces an image recorded by a recordingapparatus characterized by including: setting means for performingsetting of a still-image-with-moving-image photographing mode;still-image photographing means for performing photographing of a stillimage when a still-image photographing request is received while thestill-image-with-moving-image photographing mode is set; moving-imagephotographing means for performing photographing of a moving image whilethe still-image-with-moving-image photographing mode is set; andrecording means for recording a still image obtained as a result of thephotographing by the still-image photographing means, a moving imagephotographed by the moving-image photographing means before thephotographing of the still image by the still-image photographing means,and a moving image photographed by the moving-image photographing meansafter the photographing of the still image by the still-imagephotographing means as different files, the reproducing apparatuscharacterized by comprising: first reproducing means for reproducing,when reproduction of a still image photographed in thestill-image-with-moving-image photographing mode is requested, the stillimage obtained as a result of the photographing by the still-imagephotographing means, which is recorded in the recording means of therecording apparatus; and second reproducing means for generating, whenreproduction of a moving image photographed in thestill-image-with-moving-image photographing mode is requested, oneincidental moving image on the basis of the still image obtained as aresult of the photographing by the still-image photographing means andthe moving image obtained as a result of the photographing by themoving-image photographing means and reproducing the incidental movingimage.
 29. A reproducing method of reproducing an image recorded by arecording apparatus characterized by including: setting means forperforming setting of a still-image-with-moving-image photographingmode; still-image photographing means for performing photographing of astill image when a still-image photographing request is received whilethe still-image-with-moving-image photographing mode is set;moving-image photographing means for performing photographing of amoving image while the still-image-with-moving-image photographing modeis set; and recording means for recording a still image obtained as aresult of the photographing by the still-image photographing means, amoving image photographed by the moving-image photographing means beforethe photographing of the still image by the still-image photographingmeans, and a moving image photographed by the moving-image photographingmeans after the photographing of the still image by the still-imagephotographing means as different files, the reproducing methodcharacterized by comprising: a first reproducing step of reproducing,when reproduction of a still image photographed in thestill-image-with-moving-image photographing mode is requested, the stillimage obtained as a result of the photographing by the still-imagephotographing means, which is recorded in the recording means of therecording apparatus; and a second reproducing step of generating, whenreproduction of a moving image photographed in thestill-image-with-moving-image photographing mode is requested, oneincidental moving image on the basis of the still image obtained as aresult of the photographing by the still-image photographing means andthe moving image obtained as a result of the photographing by themoving-image photographing means and reproducing the incidental movingimage.
 30. A program executed by a processor that controls a reproducingapparatus that reproduces an image recorded by a recording apparatuscharacterized by including: setting means for performing setting of astill-image-with-moving-image photographing mode; still-imagephotographing means for performing photographing of a still image when astill-image photographing request is received while thestill-image-with-moving-image photographing mode is set; moving-imagephotographing means for performing photographing of a moving image whilethe still-image-with-moving-image photographing mode is set; andrecording means for recording a still image obtained as a result of thephotographing by the still-image photographing means, a moving imagephotographed by the moving-image photographing means before thephotographing of the still image by the still-image photographing means,and a moving image photographed by the moving-image photographing meansafter the photographing of the still image by the still-imagephotographing means as different files, the program characterized bycomprising: a first reproducing step of reproducing, when reproductionof a still image photographed in the still-image-with-moving-imagephotographing mode is requested, the still image obtained as a result ofthe photographing by the still-image photographing means, which isrecorded in the recording means of the recording apparatus; and a secondreproducing step of generating, when reproduction of a moving imagephotographed in the still-image-with-moving-image photographing mode isrequested, one incidental moving image on the basis of the still imageobtained as a result of the photographing by the still-imagephotographing means and the moving image obtained as a result of thephotographing by the moving-image photographing means and reproducingthe incidental moving image.